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FALLOUT FROM THE TESTING EXPLOSION: 

HOW 100 MILLION STANDARDIZED EXAMS UNDERMINE 
EQUITY AND EXCELLENCE IN AMERICA'S PUBLIC SCHOOLS 

"Standardized testing seems to have become the coin of the educa- 
tional realm. In recent years, it seems that the aims of education and 
the business of our schools are addressed not so much in terms of 
curriculum ... as in terms of what gets tested." 1 

- George Madaus & Walt Haney 

Standardized tests dominate the educational landscape in contempo- 
rary America. Based on a recent study, the National Center for Fair & 
Open Testing (FairTest) conservatively estimates that public schools 
in the United States administered over 100 million standardized tests 
to their 39.8 million students during the 1986-87 school year — an 
average of more than two and one-half tests per student per year. 

Standardized test results have become the major criteria for a wide 
range of school dec~ions. Test scores limit the programs students 
enter or dictate the ones in which they are placed. Some tests decide 
who will be promoted and who will be retained in grade; others 
determine which students graduate from high school. Test results 
are used to assess the quality of teachers, administrators, schools and 
whole school systems. 

Test proponents, of course, applaud these trends in the public 
schools. They see tests as "objective" mechanisms to htject accounta- 
bility into the schools and thereby improve student achievement, 
staff competence and educational quality. They see standardized 
exams as essential elements of the "School Reform Movement." 

In fact, experience with standardized test use paints quite a different 
picture. Rather than being "objective" instruments, standardized 
tests often produce results that are inaccurate, inconsistent and biased 
against minority, female and low-income students. Rather than pro- 
moting accountability, tests shift control and authority into the hands 
of an unregulated testing industry. By narrowing the curriculum, 
frustrating teachers, and driving students out of school, tests under- 
mine school improvement rather than advance its cause. 



Public schools administered over 
100 million standardized tests 
during the 1986-87 school year, an 
average of more than two and one- 
half per student per year. 



Standardized tests often produce 
results that are inaccurate, incon- 
sistent and biased against minority, 
female andlow-income students. 
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Relying on standardized tests will 
lead to a weaker, not stronger, 
educational system. 



FairTest concurs with the National Academy of Education that "the 
nation has a right to know what students achieve, what schools are 
doing, and what more should be done/' 2 Standardized tests, when 
properly constructed, validated, administered and used, can play a 
role in this effort. Too often however, standardized tests are not 
properly constructed, validated, administered and used. As a result, 
relying on standardized tests as the primary criterion for making 
various school decisions will lead to a worse, not better, public under- 
standing of the schools and a weaker, not a stronger, educational 
system. 
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I. TEST USE IN U.S. SCHOOLS 

During the 1986-87 school year, American educators reported that at 
least 94 to 105 million standardized tests were administered to 39.8 
million elementary and secondary public school students. This 
includes: 

* 38.9 million standardized achievement, competency and basic 
skills tests administered to fulfill local testing mandates; 

* 17.5 million standardized achievement, competency and basic 
slcills tests administered in 42 states and the District of Columbia to 
fulfill state testing mandates; 

* between 30 and 40 million standardized tests administered to 
compensatory and special education students; 3 

* between 1.5 and 1.75 million screening tests for kindergarten and 
pre-kindergarten students; and 4 

* between 6 and 7 million college and secondary school admis- 
sions, Graduate Equivalency Degree (GED) and National Assess- 
ment of Educational Progress (NAEP) tests. 

This data was gathered by FairTest staff through a series of tele- 
phone interviews with officials from all 50 state departments of FairTest interviewed education 
education, from the District of Columbia school district.and from 56 officials from all 50 states and the 
sample school districts in 38 states. Additional information was District of Columbia. 
gathered by examining recent surveys documenting the use of other 
standardized exams, including IQ tests, behavioral tests, readiness 
tests for young children and placement tests [see Appendix]. 

This estimate of 94-105 million tests is probably a conservative one. 
The total does not include tests administered to identify or place 
gifted or limited-English proficient students (for which there are no 
reliable figures). Nor does it include tests administered by.private 
and parochial schools to their students. 

Test use may also have been underreported by some school officials. 
For example, interviews with sources outside the New York City 
school system uncovered the use of a number of tests which had not 
been reported by school officials in the FairTest survey. 

The survey did reveal that the number of states which mandate 
testing has greatly increased in recent years. Compared to the find- 
ings of a 50-state survey conducted by Education Week in 1985: 
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The number of states which 
mandate testing has greatly 
increased in recent years. 



Southern states and larger school 
districts test more often. 



* the number of states requiring students to pass a standardized 
test for high school graduation increased from 15 in 1985 to 24 in 
1987; 

* the number of states employing standardized tests to determine 
whether students should be promoted to the next grade increased 
from 8 in 1985 to 12 in 1987; and 

* the number of states using standardized tests as part of a state as- 
sessment program increased from 37 in 1985 to 42 in 1987. s 

The FairTest survey also revealed three significant patterns of stan- 
dardized test use in public schools. First, eleven Southern states (Ala- 
bama, Arkansas,Florida, Georgia, Kentucky, Louisiana, Mississippi, 
North Carolina, South Carolina, Tennessee and Virginia) admini- 
stered standardized tests to fulfill state testing mandates at a rate 
more than twice that of schools in the remainder of the Nation. In 
fact, the five states mandating the most tests per pupil (Virginia, 
Kentucky, North Carolina, Alabama, and Georgia) were all located 
in the South. 

Second, seven states (Iowa, Minnesota, Montana, North Dakota, 
Ohio, Vermont, and Wyoming) which do not have a state testing 
mandate all have relatively small minority enrollments in their 
public schools (ranging from a low of 1% in Vermont to a high of 
only 15% in Ohio, compared to a national average of about 25%). 
Alaska is the only state without a testing mandate which also has a 
substantial minority student population (primarily Native Ameri- 
cans). However, Alaska plans to institute a state testing program in 
the 1988-89 school year. 

Finally, schools in larger school districts are likely to administer stan- 
dardized tests to fulfill local mandates at ?. higher rate than schools 
in smaller districts. The largest school districts (those with student 
enrollments exceeding 100,000) administered tests at a rate one and 
one-quarter times that of medium-s.zed districts (those with enroll- 
ments between 25,000 and 100,000) and one and one-half times that 
of the smallest districts (those with enrollments less than 25,000) . 
However, despite these overall trends, the rate of test administration 
did vary considerably among the districts. 
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II. PROBLEMS WITH STANDARDIZED TESTS 

"The importance of understanding what it is that tests can and cannot 
tfcil us is critical. Not all tests are accurate measures of the skills and 
knowledge they purport to measure and even the more accurate tests 
are at best approximations/' 6 

- Congressional Budget Office 

Standardized tests are consistently sold as scientifically developed 
instruments which simply, objectively and reliably measure student 
achievement, abilities or skills. In reality, there are serious problems 
in the construction, validation, administration and use of standard- 
ized tests and their results. 

Standardized tests are constructed in ways that often guarantee 
biased results against minorities, females and low-income students. 
Test results are evaluated and scored in ways that are often at odds 
with modern theories of intelligence and child development. The test 
validation process is often inadequate and far from objective. Many 
tests are administered in an environment that undermines any 
claims they may have to being "standardized". Even those that 
adhere to "standard" administration practices may be biasing the 
results against minorities, low-income students and females by using 
examiners who are unfamiliar to the test- takers and by using timed 
tests. 

These flaws undermine testmakers' claims of objectivity and pro- 
duce test results that are inaccurate, unreliable or biased. Ultimately, 
many tests fail to effectively measure test-takers' achievement, 
abilities or skills. 

Test Bias 

Because most standardized tests are written by and for the middie- 
to upper-class White population, their results often fail to accurately 
measure the performance of those who do not fit this category. Test- 
makers claim that the lower test scores of racial and ethnic minorities 
and of low income students simply reflect the bias and inequity that 
exists in American schools and society. While such biases and in- 
equities certainly exist, standardized tests do not just reflect their 
impact, they compound them. 

Joseph Gannon provided documentation for this conclusion in a 1980 
study for the National Conference of Black Lawyers. Gannon exam- 
ined the difference in LSAT scores of minority and White college 
seniors in the same universities and with comparable undergraduate 
grade point averages. Even after controlling for these characteristics 



Flaws in construction, validation, 
administrate and use undermine 
claims ofobjectimty and produce 
test results that are inaccurate, 
unreliable or biased. 
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Researchers have identified several 
characteristics of standardized tests 
which could bias results against 
minorities and low income 
students. 



Standardized tests assume that all 
individuals perceive information 
and solve problems in the same 
way. 



a gap of 100 points remained when Black and Hispanic scores were 
compared with those of White students even though they had dem- 
onstrated equal academic ability in college. 7 

Researchers have identified several characteristics of standardized 
tests which couJd bias results against minorities and low income 
students. Each characteristic reflects the middle- to upper-class 
White focus of such tests. As such, test results are as much a measure 
of race/ethnicity or income as they are of achievement, ability or 
skill. 3 

Some of these characteristics could also lead to gender bias in stan- 
dardized tests. However, gender bias affects both males and females. 
One finds that among very young children, some tests appear to be 
biased against boys. On the other hand, among older -hildren and 
adolescents, most bias affects girls. 

Several of the characteristics that bias test results relate to language. 
To communicate their level of achievement, ability or skills, test- 
takers must understand the language of the test. Obviously, tests 
written in English cannot effectively assess the achievement, skills or 
abilities of students who primarily speak Spanish or some other 
language. 

Many groups of English-speakers are affected by a similar, but more 
subtle, form of language bias. Most standardized tests are written in 
an elaborated, stylized language rather than the simple and common 
vernacular. Researchers have discovered that the use of such forms 
of English prevents tests from accurately measuring achievement, 
ability or skills of students who use nonstandard English dialects. 
This includes speakers of Black and Hispanic dialects and of White 
Southern, Appalachian, and working-class dialects. 8 

A related type of bias stems from stylistic or interpretive differences 
related to culture, income or gender. For instance, the word "envi- 
ronment" is often associated by Black students with terms such as 
"home" or "people". White students tend to associate it with "air", 
"clean" or "earth". Neither usage is wrong; one simply centers on ' 
the social environment while the other centers on the natural one. 
Unfortunately, on a standardized test only one of these two usages, 
generally the one reflecting the White perspective, will be accept- 
able. 9 v 

Similarly, researchers have discovered that individuals exhibit "dif- 
ferent ways of knowing and problem-solving" which reflect different 
styles, not different abilities. These differences are often correlated 
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with race/ethnicity, income level and gender. Yet standardized tests 
assume that all individuals perceive information and solve problems 
in the same way. Again, assumptions about the universal application 
of a style exhibited primarily by middle- to upper-class White males 
limits the reliability of test results. 10 

A third cause of test bias is apparent in questions which assume a 
cultural experience and perspective which not all children share. 
"Correct" answers to such questions usually reflect the experiences 
and perspectives of children and adults from a White middle- to 
upper-class background. Answers which draw upon the often differ- 
ent experiences and perspectives of racial/ ethnic minorities, children 
from poor families, and children from inner city or rural back- 
grounds are ignored. Although they may be correct in these different 
geographical or cultural contexts, they are generally counted "incor- 
rect" on the test. 

The WISC-R IQ test, for example, asks "What is the thing to do when 
you cut your finger?" The best response, according to the test, is to 
"put a bandaid on it." Partial credit is also given for a response of 
"go to the hospital." No credit is awarded for responses of "cry, 
bleed or suck on it." "Minority children usually perform poorly on 
this item. A few years ago a Baltimore, Maryland sociologist asked 
several inner-city youths why they answered the question the way 
they did She found that many of these kids answered 'go to the 
hospital 7 because they thought that cut meant a big cut. Or they 
thought it was a small cut — and since they didn't have any ban- 
daids at home, they answered 'suck on it' — and received no 
points."" 

Finally, students tend to perform better on tests when they identify 
with the subjects of the test questions. Research on Mexican- Ameri- 
cans, Blacks and girls all reveal that "items with content reference of 
special interest" to each group seem to improve their test scores. 12 
Unfortunately, standardized teste remain dominated by questions 
about and for White middle- to upper-class males. 13 

Test Construction 

In constructing a standardized test, test developers make a number 
of unwarranted assumptions. Among the most important are as- 
sumptions that results can be sorted so as to fit on a linear scale, and 
that they can be reported in the form of a single score. 

Underlying the former assumption is the belief that development of 
the knowledge, abilities or skills being tested occurs in a relatively 
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Thus standardized tests misbbel 
many, if not most, individuals who 
exhibit developmental pa terns that 
differ from a defined "norm". 


consistent fashion among A\ individuals. In fact, developmental 
researchers tell us that this simply is not true. Child language re- 
search, for example, demonstrates that "some children develop the 
use of pronouns befcre the development of an extensive noun vo- 
cabulary. For others, the reverse pattern of development occurs/' 
Neither is considered to reflect a learning disorder or disability. They 
simply refleu variations in development patterns. 14 Thus standard- 
ized tests mislabel many, if not most, individuals who exhibit devel- 
opmental patterns that differ from a defined "norm" (based on 
majority group practice) as being delayed or disordered in their 
development.^ 5 

The use of a linear scale not only creates false differences, it masks 
real differences. Assume, for example, that one student can compute 
using addition, subtraction, multiplication or division, but is unable 
to apply those concepts to fractions. Jdeanwhile, another student can 
compute with either who ; numbers or fractions, but has difficulty 
with multiplication and division. If a mathematics test included four 
questions on whole numbers and four on fractions and each question 

^CQUired the Student to pmnlov a rfiffprpnt Kmp nfromnuhHnn 

function, both students would have the same aggregate score (50%). 
Yet, their identical scores would mask real differences in skills. 


Standardized tests ignore the true 
complexity of human inte u igence. 


The assumpl n that test results can effectively be presented in the \ 
form of a unitary "score" presumes that the knowledge, skill or 
ability being measured is one-dimensional and that it tends to be 
distributed according to the statistical "normal" bell-shaped curve. 
Again research proves that this is not the case. Modern theories 
emphasize the complexity of human intelligence. Researchers have 
observed that knowledge, learning and thinking have multiple 
facets, and that a high level of development in one aspect does not 
necessarily indicate a high level of development in others." Unitary 

tpct ccnrpc anH liriPJir orai'inc* nf cm roc \cmr\ra tlio fnio ^Amnlovifu *%+\A 
icoi r»v.uico cuiu lineal dialing ui 5i.Uico lgliUic llic uUc COITipicXliy and 

thus provide a deceptive picture of individual achievement, ability 
or skills. 
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For standardized achievement tests, problems also arise when test 
publishers use national test score averages ("norms") as reference 
points for interpreting student performance. These norms are devel- 
oped by administering the test to a small group of students which, in 
theory, represents the national student population. Using these 
norms, schools can determine, for example, that a certain test score 
represents performance at the 65th national percentile, i.e. higher 
than 65% of ill ottor students. 
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However, a recent study by Friends for Education raises substantial ' 
doubt about the validity of such national norms. Friends of Educa- 
tion- "discovered that no state is below average at elementary level 
on any of the six major nationally nonned, commercially available 
tests/ 7 They concluded that "these standardized, nationally normed 
achievement tests give children, parents, school systems, legisla- 
tures, and the press misleading. reports on achievement levels. These 
tests allow all the states to claim to be above the national average." 17 

Test Validation 

Test validation determines the accuracy of a test in measuring what 
it claims to measure and the confidence one can have in conclusions 
drawn from test scores. However, validity cannot be determined in a 
vacuum. The validity of any standardized test depends entirely 
upon its context. Tests and test results are not valid for all purposes, 
but only for specific applications. 

In theory, test validity depends upon three criteria: 

* Do test results accurately measure the skills and knowledge actu- 
ally taught to the students? (This is particularly important in tests 
usev. ior diagnostic purposes.) 

* Do test results accurately correlate with future performance in the 
subject being measured? (This is particularly important in tests 
used for admissions or course placement.) 

* Do test results accurately correlate with the underlying character- 
istic or trait being measured? (This is particularly important in 
tests used to control promotions, program placement or gradu- 
ations.) 18 

In reality, validation procedures focus almost exclusively on the first 
criteria (also known as content validity) and ignore the other two 
critically important procedures. Test developers (both commercial 
institutions and governmental agencies) generally validate a test's 
use by asking "experts" to make a qualitative judgment about the re- 
lationship between individual test items and the knowledge or skills 
they seek to measure. 19 In addition, "current standardized achieve- 
ment tests are sometimes in part validated — for want of better 
criteria — by comparing scores on the tests with teachers 7 grades, . ." 
This latter approach to validation is particularly problematic, since 
"standardized tests originated [and are still promoted] in part as a 
substitute for teachers 7 judgments, which were deemed to be too 
subjective." 10 Moreover, the "experts" used to validate the tests are 
also inescapably subjective in their judgments. 
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achievement tests give children, 
parents, school systems, legisla- 
tures, and the press misleading 
reports on achievement levels." 

-Friends for Education 



The validity of any standardized 
test depends entirely uy n its 
context 
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"The term 'objective test' is a mis- 
nomer. " 

-Banesh Hoffman 



For younger children^ the chances 
of a correct placement deciswn 
being made on the basis of test 
results is only 507o~thesame odds 
as flipping a coin. 
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Given this approach to validation, standardized tests reflect just as 
much subjective human judgment as do teachers' grades or schools' 
decisions to promote or graduate students. Why then are standard- 
ized tests called "objective tests" by test developers? As Banesh 
Hoffmann notes in The Tyranny of Testing/'the term 'objective test' is 
a misnomer. The objectivity resides not in the test as a whole but 
merely in the fact that no subjective element enters the process of 
grading once the key is decided upon." 21 

Test Reliability 

Given the overall inadequacy of the validation process and the ques- 
tionable assumptions implicit in their construction, it is not surpris- 
ing that test results are often inconsistent and unreliable. The Con- 
gressional Budget Office, for example, noted that "one indication of 
the limitations of standardized tests is the often marked disparities 
in the results they yield." 22 Similarly, the Far West Laboratory for 
Educational Research and Development stated that "the older prob- 
lem of test reliability remains: standardized tests rarely achieve 
reliability coefficients above .8, leaving considerable room for error 
in the measurement of any particular child's performance." 23 A 
reliability coefficient of .8 means that 20% of the individuals taking a 
test would score above or below a statistically determined level of 
test score variation if they were retested. Thus, scores (and the 
decisions made based on these scores) radically over- or underesti- 
mate the knowledge, skills or abilities possessed by at least one in 
every five students tested. 

For younger children (those through grade 2), reliability is even 
worse — often only .5, according to Sue Bredekamp, director of early 
childhood programs for the National Association for the Education 
of Young Children (NAEYC). This means that the chances of a 
correct placement decision being made on the basis of test results is 
only 50% — "the same odds as flipping a coin." 24 

Test Administration 

Educators, researchers and members of the public generally assume 
that standardized tests are administered in a standardized context 
under relatively uniform conditions. Anne Anastasi in Psychological 
Testing emphasized the importance of such a controlled setting: 
"Even apparently minor aspects of the testing situation may appre- 
ciably alter performance. . . In general, children are more susceptible 
to examiner and situational influences than are adults; in the exami- 
nation of preschool children, the role of the examiner is especially 
crucial." 25 
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In feet, recent research has demonstrated that tests are administered 
in for from "standard" conditions. One study concluded that "the 
actual context [of test administration] often includes confusion, anxi- 
ety, behavioral resistance, negative attitudes toward testing on the 
part of staff and students, lack of properly trained test examiners, de- 
velopmental or educationally immature children and other institu- 
tional problems that are endemic to many schools/' 26 Given the 
reality of improper test administration, the use of these test results is 
likely to lead to educationally unsound decisions. 

Moreover, many of the ideal "standard" conditions called for by test 
developers may actually place certain groups of students at a disad- 
vantage. For example, the use of unfamiliar test examiners reduces 
test scores of low SES (socioeconomic status) and Black students, but 
does not affect the scores of high SES students. This factor alone can 
account for half of the difference in I.Q. test scores between low and 
high SES students. 27 Similarly, the time limitations associated with 
most standardized tests harm minorities. Generally, these groups 
appear to cope less effectively with the pressures inherent in a time- 
limited test than do White males. 23 
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that tests are administered in far 
from "standard" conditions. 



The use of unfamiliar test 
examiners reduces test scores of tow 
SES and Black students, but does 
not affect the scores of high SES 
students. 
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III. THE IMPACT OF THE MISUSE OF TESTS 
BY THE PUBLIC SCHOOLS 

"The adverse impact of an educational system based on tests may be 
far worse than anticipated. A lesson is to be learned from an English 
experiment [in 1863] which utilized tests as a basis for accountability. . 
. What transpired was nothing short of disaster . . Almost all courses 
that were not addressed in the test were dropped and reading materi- 
als were limited to those that appeared on the tests. . . Some teachers 
quickly left the system and prospective teachers were reluctant to enter 
a profession that operated in this manner.* Needless to say 'payment by 
results' was abandoned in fairly short order/' 29 

-MaryDilworth 

Traditionally, standardized tests have been one of several educa- 
tional tools used to assess student achievement and to diagnose their 
academic strengths and weaknesses. In recent years, American 
public schools, like their British counterparts more than a century 
ago, have begun to treat standardized tests as the all-purpose answer 
for promoting school improvement and ensuring school accountabil- 
ity. In the process, standardized tests have become the primary or 
sole criterion used by public schools for making a number of deci- 
sions affecting students, teachers and schools. In many schools, 
standardized tests serve as gatekeepers for 

* assignment to special education or remedial programs; 

* admission to gifted and talented or accelerated programs; 



American "public schools have 
begun to treat standardized tests as 
the all-purpose answer for 
promoting school improvement 
and ensuring school accountability. 



* grade promotions; 

* high school graduation; 

* merit pay awards to teachers; 

* teacher certification and recertification; 



* allocation of funds to schools or school systems; and 

* school system certification and decertification. 



Reliance on standardized tests as educational gatekeepers is grow- 
ing. In just the last two years, the number of states using tests to 
determine student promotions increased from 8 to 12. Similarly, the 
number of states using tests to determine eligibility for high school 
graduation increased from 15 to 24. 
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The use of standardized tests as the 
primary or sole criteria for making 
any "high stakes" decision is 
reckless. 



"Social, emotional, moral, and 
physical development and learning 
are virtually ignored in schools 
with mandated testing programs." 
-NAEYC 
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Given the limited range of skills and knowledge measured by stan- 
dardized tests, the impact of race, ethnicity, income and gender on 
test results, and questions regarding their proper construction, 
validation and administration, the use of standardized tests as the 
primary or sole criteria for making any "high stakes" decision is 
reckless. Moreover, as standardized tests have become the all- 
powerful gatekeepers of American education, they have affected 
educational goals and curriculum, student progress and achievement 
and local control — and created a new set of problems in each area. 

Impact on Educational Goals and Curriculum 

Children go to school not just to learn basic academic skills, but also 
to develop the personal, intellectual and social skills to become 
happy, productive members of a democratic society. Unfortunately, 
the current emphasis on standardized tests threatens to undermine 
this educational diversity by forcing schools and teachers to focus on 
quantifiable skills at the expense of less easily quantifiable academic 
and non-academic abilities. 

This is particularly true for young children. As the National Associa- 
tion for the Education of Young Children (NAEYC) recently noted: 
"Many of the important skills that children need to acquire in early 
childhood — self-esteem, social competence, desire to learn, self- 
discipline — are not easily* measured by standardized tests. As a 
result, social, emotional, moral, and physical development and learn- 
ing are virtually ignored or given minor importance in schools with 
mandated testing programs." 30 

Many schools have embarked on a single-minded quest for higher 
test scores even though this severely narrows their curriculum: 31 

* Deborah Meier, a successful principal of a public school in Man- 
hattan, noted that when synonyms and antonyms were dropped 
from the New York City test for word meaning, teachers promptly 
dropped academic material that stressed them. She also noted that 
students read "dozens of little paragraphs about which they then 
answer multiple choice questions" — an approach that duplicates 
the form of the standardized tests the students take in the spring. 32 

* Gerald Bracey, former Director of Research, Evaluation and 
Testing in the Virginia Department of Education, noted that some 
teachers did not teach their students how to add and subtract 
fractions because the state's minimum competency test included 
questions on multiplication and division of fractions, but not on 
their addition and subtraction. 33 
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* In one Georgia school, the goal in essay writing is to produce "a 
five-paragraph argumentative essay written under a time limit on 
a topic aboutvwhich the author may or may not have knowledge, 
ideas, or personal opinions''. Not surprisingly, this exercise exactly 
matched the requirement for the Georgia Regents' Test essay 
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exam. 



Sometimes, the curriculum is narrowed simply because "testing 
takes time, and preparing students for testing takes even more time. 
And all this time is time taken away from real teaching/' 35 Unfortu- 
nately, a closer link between tests and curriculum has become a very 
conscious goal for some school system?; 

School systems in at least 13 states and the District of Columbia are 
seeking to "align" their curriculum so that students do not spend 
hours studying materials upon which they will never be tested re- 
gardless of the value or benefits which could be derived from that 
effort. 36 As a result, curriculiun alignment "subordinates the process 
of curriculum development to external testing priorities, namely the 
state minimum-competency exam. Thus, the curriculum falls in line 
with the test, and, for all intents and purposes, the test becomes the 
curriculum." 37 

The educational price paid.for allowing tests to dictate *he curricu- 
lum can be a high one. Julia R. Palmer, Executive Director of the 
American Reading Council, recently wrote, "[T]he major barrier to 
teaching reading in a common-sense and pleasurable way is the 
nationally normed standardized second grade reading test." Ms. 
Palmer explained that the test questions force teachers and students 
to focus on "reading readiness" exercises and workbooks in their 
early grades and not on reading. As a result, many students become 
disenchanted with reading because they rarely get a chance to 
participate in it or to read anything of real interest to them. 33 

Just as curriculum has been nr -rowed, so too have textbooks. Diane 
Ravitch argues that "textbooks full of good literature began to disap- 
pear from American classrooms in the 1920's, when standardized 
tests were introduced. Appreciation of good literature gave way to 
emphasis on the 'mechanics' of reading." 39 Similarly, a recent report 
by the Council for Basic Education concluded that the emphasis on 
standardized tests and curriculum alignment are among the main 
causes of the increasingly poor quality of textbooks. The report noted 
that "instead of designing a book from the standpoint of its subject 
or its capacity to capture the children's imagination, editors are 
increasingly organizing elementary reading series around the con- 
tent and time of standardized tests. . . As a result, much of what is in 
the textbooks is incomprehensible." 40 
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goals of the current school im- 
provement movement. 
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in educational services, particularly 
for minority and low-income 
students. 
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Finally, by narrowing the curriculum, standardized tests are under- 
mining many of the most important goals of the current school im- 
provement movement. Current school reform efforts have sought to 
promote "higher-order thinking skills' 7 , imagination and creativity in 
American students. Yet standardized tests focus on basic skills, not 
critical thinking, reasoning or problem- solving. They emphasize the 
quick recognition of isolated facts, not the more profound integration 
of information and generation of ideas. 41 As Linda DarlingrHam- 
mond of the Rand Corporation concluded, "If s testing for the TV 
generation — superficial and passive. We don't ask if students can 
synthesize information, solve problems or think independently. We 
measure what they can recognize." 42 

Impact on Student Progress and Achievement 
By controlling or compelling student placement in various educa- 
tional programs, standardized tests perpetuate and even exacerbate 
existing inequities in educational services, particularly for minority 
and low-income students. Thus, standardized test results lead to 
larger numbers of racial and ethnic minorities being placed in special 
education and remedial education programs. For example, in 1984, 
40% of Black five-year-olds in South Carolina failed standardized 
tests used to determine eligibility for kindergarten. These students 
were tracked into remedial classes on the basis of unreliable exams 
even before their formal schooling had begun. 43 

Standardized tests also perpetuate the domination of white upper- 
middle class students in "advanced" classes. In New York City for 
example, IQ tests are used in some districts to place children in 
"gifted and talented" programs, creating White, upper-middle class 
enclaves in districts whose enrollment is dominated by racial and 
ethnic minorities. 44 Similarly, test results assign boys to advanced 
math and science programs and keep girls out. In the end, they both 
narrow the educational opportunities available to many segments of 
our student population and maintain the isolation of different racial 
and social groups and classes. 

At the same time, standardized tests, particularly when used as pro- 
motional gates, can act as a powerful exclusionary device — again 
aimed disproportionately at minority and low-income students. 
Academic research has demonstrated that, for a student who has 
repeated a grade, the probability of dropping out prior to graduation 
increases by 40%. 4S Thus students who are not promoted because 
they fail an often unreliable and biased standardized test are consid- 
erably more likely to become high school dropouts. 
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Nor does the.use of standardized tests affect only low-achieving 
students. High-achieving.students are likely to be frustrated by a 
narrowed curriculum, which has been "dumbed down" in response 
to standardized tests, particularly minimum competency tests. These 
students tod are likely to drop out in higher numbers. 46 

The most insidious effect of the overuse of standardized tests is on 
teachers' perceptions of their students. The existence of a "Pygma- 
lion effect" as it relates to test results has long been a source of 
controversy. However, a 1984 study by Stephen Raudenbush has 
carefully documented its existence for students entering a new 
school (in this case, 7th grade students entering junior high school). 47 
Where teachers have little information on students, contusions 
about student knowledge, skills, and abilities based on often inaccu- 
rate and unreliable test results can become self- fulfilling prophesies. 

Impact on Local Control 

Because standardized tests increasingly determine what is taught in 
the classrot m, parents and other citizens are losing their traditional 
control over the public schools. This shift of power from local com- 
munities to state and national government reduces the level of input 
and influence available to both parents and teachers in the manage- 
ment of the schools. This, in turn, reduces "the responsiveness of 
schools to their clientele and so reduces the quality of education" 
available in those schools. 43 

Local control over the schools is also being lost to private organiza- 
tions, namely the test developers. States and school districts have 
neither the expertise nor the resources to independently develop and 
validate the standardized tests that they need. Instead they turn to 
private testing companies, who design and market a tremendous 
variety of products. Even here, states and school systems have 
neither the skills nor the funds to adequately investigate claims by 
test developers regarding test validation or to review the test valida- 
tion process. 49 

Despite the significant and growing role their products play in edu- 
cational decisions, testing manufacturers face little government regu- 
lation or supervision. Unlike other businesses/ such as communica- 
tions, food & drugs, transportation, and securities/ there are virtually 
no regulatory structures at either the Federal or State level governing 
the billion dollar a year testing industry. 

States and school systems have neither the expertise nor the re- 
sources to adequately evaluate the claims made by the testing indus- 
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"It is practically impossible for a compe- 
tent test technician or test consumer to 
make a thorough appraisaL.because of 
the limited amount of trustworthy in- 
formation supplied by the test publish- 

***** ff 
ers. 

-Oscar K.Buros 



try. Nor are they able to independently determine the reliability and 
validity of test results. 50 Even if the expertise and resources did exist, 
the secrecy which is rampant in the testing industry would likely 
prevent any effective outside evaluation. As the iate Dr. Oscar K 
Buros (editor of the Mental Measurement Yearbook) lamented, "It is 
practically impossible for a competent test technician or test con- 
sumer to make a thorough appraisal of the construction, validation, 
and use of standardized tests. . . because of the limited amount of 
trustworthy information supplied by the test publishers." 51 
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IV. AN AGENDA FOR TEST REFORM 

FairTest concurs with the National Academy of Education that "in- 
formation on student progress, wisely interpreted, is of obvious 
value to the public, to educators and to policymakers at all levels of 
government." 5 ? When properly constructed, validated, administered 
and used, standardized tests can serve as a tool in this effort. 

Unfortunately,; it has become all too obviou5 that standardized tests 
are not properly constructed, validated and administered. Moreover, 
their misuse is creating problems for students, teachers and the 
schools themselves. The question arises then: What should be done 
to reform tests and test use in the public schools? 

In response tathe misuse of standardized tests in U.S. society, 
FairTest has developed an agenda to answer this question. Our 
Testing Reform Agenda is guided by four basic principles: 

• Tests should measure pertinent, not extraneous, knowledge dif- Tests must be properly 
ferences between students. Questions must be relevant to the knowl- constructed, validated 
edge, abilities or skills being tested. Test items and instructions and administered, 

should be written clearly and accurately. The tests themselves 
should take into account the diversity of language, experience and 
perspective embodied in the test-taking population. If necessary, 
different tests should be used for different population groups to 
ensure the elimination of bias. At the same time, questions and 
scoring procedures should acknowledge the complexity and diver- 
sity of intelligence and individual development. 

Test validation should ensure that the content of the test matches the 
content of what is taught, but test developers cannot stop at content 
validation. They must document assumptions about the relationship 
between test results and future performance. At the same time, they 
must demonstrate that test results are accurately related to the 
underlying knowledge, skills and abilities the test claims to measure. 

Finally, those who develop and use standardized tests must ensure 
that the testing environment is both consistent for and supportive of 
all test-takers. Where the environment cannot be made standard and 
supportive, the only alternative is to refrain from testing. Moreover, 
the standard environment must not be constructed in a manner that 
creates disadvantages for particular students through artificial dis- 
tractions or pressures. 

21 
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Tests should be open* • Public schools, test-takers and independent researchers should 

have access to the descriptive and statistical data needed to verify 
test publishers' claims regarding test construction and validation. 
This should include the release of questions used on previous tests, 
as well as data on test results (identified by race/ethnicity, gender, 
SES, geographical residence, and other demographic distinctions). 

Test publishers have long argued against the release of old test ques- 
tions. They have claimed that any large-scale release would require 
the development of a massive number of new items, thus increasing 
test development cost. This may not be the case. A recent study 
found that the release of old test questions did not affect test scores. 53 
Thus the release of old test questions may not require such a large 
scale development of new questions. 

Test users or independent public agencies should also fully investi- 
gate the claims of test publishers regarding the construction and 
validity of the tests. At the same time, they should disclose and 
monitor their own processes for test administration. 

Tests should be viewed in • Both test developers and test users should work to ensure that 

the proper perspective. test results are properly interpreted and employed by educators, 

policymakers, test-takers and the general public. As the 1974 Stan- 
dards for Educational and Psychological Tests states: "A test score 
should be interpreted as an estimate of performance under a given 
set of circumstances. It should not be interpreted as some absolute 
characteristic of the examinee or as something permanent and gener- 
alizable to all other circumstances/ 7 This standard has too often been 
ignored by those who use test results. At a minimum, test scores 
should not be used as the sole or primary factor in "high stakes" 
educational decisions. 

At the same time, test developers and test users must recognize that 
standardized tests are only limited measures of educational reality. 
Used alone, they present distorted pictures of what they seek to 
measure and often undermine the quality of education offered in our 
public schools. Both test developers and test users have the affirma- 
tive obligation to promote a proper, reasonable and limited use of 
standardized tests as one of a series of assessment mechanisms. 



22 

23 



ERLC 



• Standardized multiple-choice tests can only measure a very 
limited range of student knowledge, abilities and skills. Emerging 
technologies provide new opportunities to expand our capability to 
more fully and accurately measure a greater range of knowledge, 
abilities and skills, while complementing the quantitative nature of 
current tests. These can be used to diagnose the strengths and weak- 
nesses of students in order to help them learn, rather than to sort, 
stratify:or segregate them. Despite claims that testing is now more 
advanced and scientific, Oscar Buros noted that "little progress has 
been made in the past fifty years — in fact in some areas, we are not 
doing as well. Except for the tremendous advances in electronic 
scoring, analysis and reporting of test results, we don't have a great 
deal to show for fifty years' work. Essentially, achievement tests are 
being constructed today in the same manner they were fifty years 



Although FairTest believes that those institutions that develop and 
use standardized tests have a primary obligation to reform tests and 
test use, government also has a major role to play. By establishing 
guidelines for the testing industry, requiring information on stan- 
dardized tests to be made public, and analyzing test results to guard 
against bias, the government can go a long way toward improving 
tlie quality of tests and test use. More importantly, public agencies 
can set the standard for intelligent and proper use of test results. Too 
often, government is the biggest misuser of standardized test results. 

Unfortunately too many policymakers and educators have ignored 
tne complexities of testing issues and the obvious limitations they 
place upon standardized test use. Instead, they have been seduced 
by the promise of simplicity and objectivity. The price which has 
been paid by our schools and our children for this infatuation with 
tests is high. Unless Americans act now to limit and reform the use 
of standardized tests in the schools, that price will continue to in- 
crease. 
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APPENDIX 



DESCRIPTION OF FAIRTEST SURVEY AND RESULTS 

Study Methodology 

In mid-1987, FairTest staff conducted a series of telephone inter- 
views with officials from all 50 state departments of education, from 
the District of Columbia school district and from 56 sample school 
districts in 38 states. Intervl ws of state officials focused on stan- 
dardized tests administered by the public schools to fulfill testing 
mandates established by the state, while interviews of school district 
officials focused oh tests administered to fulfill testing mandates es- 
tablished by the district. All interviews sought responses to three 
basic questions: 

* How many tests were administered by the public schools to fulfill 
the state or local testing mandates? 

* Which standardized tests were used to fulfill the state or local 
testing mandates? 

* For what purposes did the state or school district mandate stan- 
dardized tests? 

The responses collected through these interviews related entirely to 
the use of standardized achievement, competency or basic skills 
tests. Public schools also use many other standardized exams, 
including IQ tests, behavioral tests, readiness tests for young chil- 
dren, and placement tests for special education, remedial education 
and bilingual education programs. However, the use of these tests 
varies considerably among schools, even within the same districts, 
and records of their use appear to be unreliable or nonexistent. Thus 
the study results reflr:t only a portion of the standardized tests 
actually administered to students by the public schools. 



Study Results 

State-Level Testing Mandates. During the 1986-87 school year, 
schools in 42 states and the District of Columbia administered over 
17.5 million standardized achievement, competent/ and basic skills 
tests to almost 36.3 million students to fulfill state testing mandates 
— a rate of almost one test for every two students. This rate varied 
considerably among the states however. A detailed listing of the 
number of standardized tests administered by the public schools in 
each state to fulfill state testing mandates is presented in Table 1. 
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On average, schools in the South administered standardized tests to 
fulfill state mandates at much higher rates than schools in the re- 
mainder of the nation. Schools in the 11 Southern states (Alabama, 
Arkansas, Florida, Georgia, Kentucky, Louisiana, Mississippi, North 
Carolina, South Carolina, Tennessee and Virginia) administered 
more than 6.7 million tests to over 9.3 million students — a rate of 
one test for every 1.3 students. Schools in the remaining 31 states ad- 
ministered tests at about half that rate — one test for every 2.5 stu- 
dents. In fact, schools in all but one Southern state (Florida) admini- 
stered tests at a rate higher than the average for the remainder of the 
Nation. Moreover, the five states with the highest rates of test 
administration were all in the South. Virginia, Kentucky, North 
Carolina, Alabama, and Georgia all administered about one test per 
student. 

Outside the South, no clear patterns of test use to fulfill state man- 
dates emerged. Although schools in New Mexico, a state with a 
minority population in the public schools above the national average, 
reported a high rate of standardized test use, so did schools in Utah, 
a state with a relatively low minority population. Conversely, 
schools in states like Texas and California, with relatively high 
minority populations in the public schools, reported rates almost 
equal to Wisconsin and Kansas, states with relatively low minority 
populations. 

A clear pattern did emerge among the eight states (Alaska, Iowa, 
Minnesota, Montana, North Dakota, Ohio, Vermont and Wyoming) 
which did not have any state testing mandates. Seven of these eight 
states have minority student populations significantly below the 
national average. While minorities make up more than one-quarter 
of the public school students nationwide, the minority student popu- 
lations in these seven states range from a high of 15% in Ohio to a 
low of 1% in Vermont. Most in fact have minority populations that 
are less than 10% of the total student population. The one exception 
is Alaska, with a large Native American population, and an overall 
minority population just above the national average. However, 
Alaska will also implement a state testing mandate beginning in the 
1987-88 school year. 

District-Level Testing 

During the 1986-87 school year, schools in the 56 sample school dis- 
tricts administered more than 7.8 million standardized tests to over 
5.7 million students to meet local testing mandates — a rate of one 
and one- third tests for every student. However, the rate of test ad- 
ministration among districts varies even more than it did among 
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different states. A detailed listing of the number of standardized 
tests administered by the public schools in each of the sample school 
districts to fulfill local testing mandates is presented in Table 2. 

The schools in Newark, New Jersey are excluded from the discussion 
in the following paragraph due to their extremely high reliance on 
standardized tests. During the 1986-87 school year, schools in 
Newark administered over 600,000 standardized tests to about 
67,000 students a rate of more than 9 tests per student. This rate 
was more than three times that of the next highest school system. 

Excluding the Newark school system, the rate of test administration 
ranges from a high of almost 3 tests per student in Qeveland to a " 
low of only one test per 12.5 students in Fairfax County, Virginia. 
Overall, six districts reported administering more than 2 tests per 
students per year, while seven others reported administering less 
than 1 test for every 2 students. 

To analyze the variations among the different rates of tests admini- 
stered by the different districts, districts were categorized by size. 
Three categories were created: large districts (with student popula- 
tions exceeding 100,000); medium- sized districts (with populatio s 
between 25,000 and 100,000); and small districts (with populations 
below 25,000). The results from Newark were excluded from these 
calculations. On average, large districts administered standardized 
tests to fulfill local testing mandates at a rate (1.38 tests per student) 
25% higher than that of medium-sized districts (1.11 tests per stu- 
dent). The rate of mec.am-sized districts, in turn, exceeded that of 
small districts (0.88 tests per student) by almost thesame proportion. 

The estimate that schools administered almost 38.9 million standard- 
ized achievement, competency and basic skills tests to 39.8 million 
students during the 1986-87 school year to fulfill local testing man- 
dates is based upon these average variations and the distribution of 
students among school districts of different sizes. (See Table 3 for the 
detailed computations.) Combining this figure with the tests ad- 
ministered to fulfill state testing mandates produces an estimate of 
56.4 million standardized achievement-type tests administered by 
the public schools during the 1986-87 school year, or 1.4 tests for 
every public school student. 
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Although the FairTest survey focused on the use of standardized 
acruevernent, competency ana oasic sxiiis tests in tne puoiic scnoois, 
public schools also use standardized tests for a variety of other pur- 
poses. These include: 




* tests administered to gifted, disadvantaged, handicapped and 

\ limited-English proficient student for placement into or graduation 
I s from gifted & talented, compensatory education, special education 
1 and bilingual education programs; 

* college admissions tests administered to high school juniors and 
seniors; 




* admissions tests administered to students seeking to enroll in 
particular secondary schools in certain communities; 




* screening tests administered to kindergarten and pre- kindergar- 
ten students; 




* GED (General Education Development) tests administered to in- 
dividuals who did not complete high school; and 




lcdlo auiiuiiioLci txi iu rdnuuiruy selected samples or students as 
part of the U.S. Department of Education's National Assessment of 
Educational Progress. 




ui auuiuuii; ouiiic scnuui ojoicHib continue iu administer i\£ tests to 
their entire student populations, although most school districts ad- 
minister IQ tests only for placement purposes. 




As noted previously, information on the number of other standard- 
ized tests administered was neither as specific nor as reliable as the 
information gathered for achievement, competency and basic skills 
tests. /\s a result, it is not possioie to compute specific totals on tne 
use of these tests. From a variety of sources, however, general 
figures can be obtained: 




* Test publishers have reported that the total number of college and 
secondary scnooi admissions, \jhu and JN A br tests administered 
to elementary and secondary school students was between 6 and 7 
million. 




* A survey conducted in the early 1980's indicated that students in 
compensatory education and special education programs were 
I tested two to three times as often as their peers in mainstream 
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education program. 1 Since the mainstream student is administered 
1.4 standardized tests per year (according to our survey), compen- 
satory and special education students are administered between 3 
and 4 standardized tests per year. Given that over 10 million 
students participate in Federally- funded compensatory and 
special education programs, an estimated 30 to 40 million addi- 
tional standardized tests are administered to these students. 

* A survey conducted in 1985 concluded that almost half of the kin- 
dergarten and pre-kindergarten students in the public schools 
were administered screening tests. 2 Based upon the 1985 kinder- 
garten enrollment, this means that between 1.5 and 1.75 million 
tests were administered to these children. 

This total (which still excludes tests administered to gifted and lim- 
ited-English proficient students and some proportion of I.Q. testing) 
yields an additional 37.5 to 48.75 million tests. 



Summary 

The results of the FairTest survey revealed that at least 56.4 million 
standardized achievement-type tests were administered to public 
school students in the 1986 - 87 school year. An additional 37.5 to 
48.75 million standardized tests were administered by the public 
schools to their students for other purposes during that year. Based 
on these two estimates, between 94 million and 105 million standard- 
ized tests were administered to 39.8 million students in the public 
schools. 



NOTES 



1 A.K. Wigdor & W.R. Gamer (eds.). Ability Testing: Uses, Consequences and Controver- 
sies (National Academy Press, 1982) pp. 252-253. 

2 Educational Research Services, Inc. Kindergarten Programs & Practices in the 
Public Schools (1986). 
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TABLE 1. Number of Standardized Tests Administered in the Public Schools 
To Fulfill State Mandates, By State (1986-1987 School Year). 



NUMBER OF SCHOOL STATE-MANDATED 
STATE TESTS ENROLLMENT TESTS PER STUDENT 



Alabama 


720,000 


733,735 


0.98 


Alaska 


0 


107,973 


0.00 


Arizona 


480,000 


534,538 


0.90 


Arkansas 


179,000 


437,438 


0.41 


California 


1,420,000 


4,377,989 


0.32 


Colorado 


208,800 


558,415 


0.37 


Connecticut 


99,000 


468,847 


0.21 


Delaware 


60,000 ' 


94,410 


0.64 


District of Columbia 


119,000 


85,612 


1.39 


Florida 


437,352 


1,607,320 


027 


Georgia 


1,020,000 


1,096,425 


0.93 


Hawaii 


75,000 


164,640 


0.46 


Idaho 


30,000 


208,391 


0.14 


Illinois 


418,000 


1,825,185 


0.23 


Indiana 


211,000 


966,780 


0.22 


Iowa 


0 


481,296 


0.00 


Kansas 


135,000 


416,091 


0.32 


Kentucky 


650,000 


642,778 


1.01 


Louisiana 


390,000 


795,188 


0.49 


Maine 


48,000 


211,752 


0.23 


Maryland 


168,000 


675,747 


0.25 


Massachusetts 


410,000, 


833,918 


0.49 


Michigan 


326,285 


1,681,880 


0.19 


Minnesota 


0 


711,134 


0.00 


Mississippi 


240,000 


498,639 


0.48 


Missouri 


664,000 


800,606 


0.83 


Montana 


0 


153,327 


0.00 


Nebraska 


20,508 


267,139 


0.08 


Nevada 


55,000 


161,239 


0.34 


New Hampshire 


30,000 


163,717 


0.18 


New Jersey 


630,000 


1,107,467 


0.57 


New Mexico 


80,000 


281,943 


0.28 


New York 


1,691,000 


2,607,719 


0.65 


North Carolina 


1,085,000 


1,085,248 


1.00 


North Dakota 


0 


118,703 


0.00 


Ohio 


0 


1,793,508 


0.00 


Oklahoma 


234,000 


593,183 


0.39 


Oregon 


15,000 


449,307 


0.03 


Pennsylvania 


538,212 


1,674,161 


0.32 


Rhode Island 


40,000 


134,126 


0.30 


South Carolina 


.450,000 


611,629 


0.74 


South Dakota 


50,000 


125,458 


0.40 


Tennessee 


500,000 


818,073 


0.61 


Texas 


1,500,000 


3,209,515 


0.47 


Utah 


258,000 


415,994 


0.62 


Vermont 


0 


92,112. 


0.00 


Virginia 


1,069,000 


975,135 


1.10 


Washington 


182,000 


761,428 


0.24 


We. c t Virginia 


200,000 


351,837 


057 


Wisconsin 


309,000. 


767,819 


0.40 


Wyoming 


0 


100,955 


0.00 



UNITED STATES 



17,545,159 



39,837,459 



0.44 



Table 2. Standardized Tests Administered in the Public Schools 
To Fulfill State Mandates (1986-1987 School Year).. 

DISTRICT-MANDATED 
NUMBER OF SCHOOL TESTS 



SCHOOL DISTRICT 


TESTS 


ENROLLMENT 


PER STUE 


CALIFORNIA 

Los Angeles 

San Juan Unified 

San Francisco 

San Diego City Unified 


949,899 
33,000 
21,000 
34,040 


540,903 
44,186 
58,378 

110,631 


1.76 
0.75 
0.36 
0.31 


COLORADO* 
Jefferson County 


52,500 


76,000 


0.69 


CONNECTICUT 
Greenwich 


5,720 


6,772 


0.84 


FLORIDA 

Hillsborough County (Tampa) 
Pinellas County (Clearwater) 
Duyall County (Jacksonville) 
Dade County (Miami) 
Broward Cty. (R. Lauderdale) 


98,000 
112,000 
190,000 
230,000 
336,000 


115,323 
85,339 
99,512 
250,000 
129,478 


0.85 
1.31 
1.91 
0.92 
2.60 


GEORGIA 

Fulton County (Atlanta) 
DeKalb County (Decatur) 


13,000 
15,000 . 


35,523 
66,000 


0.37 
0.23 


ILLINOIS 
Chicago 


468,544 


435,000 


1.08 


INDIANA 
Indianapolis 


66,600 


50,600 


1.32 


IOWA 

Des Moines Independent 


44,500 


30,000 


1.48 


KANSAS 
Wichita 


65,729 


44,729 


1.47 


KENTUCKY 

Jefferson County (Louisville) 


47,000 


95,020 


0.49 


LOUISIANA 

Orleans Parish (New Orleans) 


84,000 


84,000 


1.00 


MARYLAND 
Baltimore City 
Prince Georges County 


275,800 
175,000 


120,000 
103,000 


2.30 
1.70 


MASSACHUSETTS 

Boston 

Brookline 


60,000 
3,500 


55,000 
5,400 


1.09 
0.65 


MICHIGAN 
Detroit City 


269,000 


200,000 


1.35 


MINNESOTA 
Minneapolis 


39,712 


32,274 


1.23 



3£r 



SCHOOL DISTRICT 



DISTRICT-MANDATED 
NUMBER OF SCHOOL TESTS 

TESTS ENROLLMENT PER STUDENT 



MISSOURI 
St Louis 

MONTANA 
Missoula 

NEVADA 
Las Vegas 

NEW HAMPSHIRE 
Concord 

NEW JERSEY 
Newark 

NEW MEXICO 
Albuquerque 

NEW YORK 
New York City 
Rochester 
Buffalo City 

NORTH CAROLINA 
Mecklenburg Cty. (Charlotte) 
Wake County (Raleigh) 

NORTH DAKOTA 
Fargo 

OHIO 
Cincinnati 
Akron 
Cleveland 

OKLAHOMA 
Oklahoma City 

OREGON 
Portland 

PENNSYLVANIA 
Philadelphia 

SOUTH CAROLINA 
Greenville County 

TENNESSEE 
Memphis City 

TEXAS 

Dallas Independent 
Houston Independent 

UTAH 

Salt Lake City 



119,327 
6,990 
87,684 
7,296 
603,000 
133,320 



1,133,000 
35,000 
63,000 



18,000 
40,500 



6,000 



123,800 
20,520 
219,000 



31,300 
30,000 

400,000 
37,000 

188,200 



217,584 
250,000 



56,000 



48,800 
5,640 

95,000 
5,000 

67,000 

80,000 



924,123 
34,696 
44,707 



72,162 
58,213 



9,200 



53,000 
34,000 
75,000 



40,000 
52,000 

200,000 
53,000 

106,000 



127,584 
193,702 



72,000 



2.45 



1.24 



0.93 



1.46 



9.00 



1.67 



1.23 
1.01 
1.41 



0.25 
0.70 



0.65 



2.34 
0.60 
2.92 



0.78 
058 
2.00 
0.70 
1.76 



1.71 
129 



0.78 



SCHOOL DISTRICT 



DISTRICT-MANDATED 
NUMBER OF SCHOOL TESTS 

TESTS ENROLLMENT PER STUDENT 



VERMONT 
Burlington 

VIRGINIA 
Fairfax County 
Virginia Beach City 
Prince William County 

WASHINGTON 
Seattle 

WEST VIRGINIA 

Kanawha County (Charleston) 

WISCONSIN 
Milwaukee 

WYOMING 

Laramie County (Cheyenne) 



2,212 3,800 0.58 

10,000 124,631 0.08 

0 54,870 0 

105,000 57,213 1.84 

41,500 44,000 0.94 

20,300 37,399 0.54 

64,500 96,387 0.67 

11,000 13,000 O.o4 
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TABLE 3. COMPUTATION OF ESTIMATE OF STANDARDIZED TESTS ADMINISTERED BY PUBLIC SCHOOLS TO 
FULFILL STATE OR LOCAL TESTING MANDATES (1986-87 SCHOOL YEAR). 



SURVEYED 



ESTIMATED 



TOTAL 



TYPE OF 
SYSTEM 



STUDENTS 



TESTS 



RATE 



STUDENTS TESTS 



STUDENTS 



TESTS 



LARGE 

(OVER 100,000) 



3,680,375 



5,035,067 



1.37 



3,680,375 5,035,067 



MEDIUM 
(25,000 TO 100,000) 



2,026,008 2,790,792 1.11 



4,674,000 5,188,000 



6,700,008 



7,978,792 



SMALL 

(LESS THAN 25,000) 



48,812 



42,718 



0.88 



29,408,000 25,879,000 



29,456,812 25,921,718 



TESTS ADMINISTERED TO FULFILL - 


TESTS IN SURVEY 


ESTIMATED TESTS 


TOTAL TESTS 


STATE MANDATES 


17,545,159 




17,545,159 


LOCAL MANDATES 


7,868,577 


31,067,000 


38,935,577 


ALL MANDATES 


25,413,736 


31,067,000 


56,480,736 



NOTE: The computation of the testing rate in medium-sized school systems excludes the unusually high testing rate of Newark, New J< 
(which is three times higher than the next highest system.) The estimated number of tests admirfotercd in medium and small school sy* 
was computed using the actual rate administered for medium and small systems based on survey results. 
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ANNOTATED BIBLIOGRAPHY 






1. GENERAL DISCUSSIONS OF TESTING 




Bastian, A., et.al. 


Choosing Equality: lite Case for Democratic Schooling. (Temple 
University Press: Philadelphia, PA, 1986), 

This book concludes that democratizing schools so as to meet the 
needs of all students ought to be the focus of school reform efforts. 
Standardized tests are seen as one of the means used to prevent 
equality and quality for all. 




FairTest. 


FairTest Examiner. 

This newsletter surveys developments in testing and testing reform, 
including grade school, IQ and related tests. 

Unis is available from rairiest, box iz/z, Vwamonage, MA uzzooj 


* 


FairTest. 


Update onK-12 Testing. 

A biannual selection of newspaper and journal articles on grade 
school, IQ and related tests and testing reform efforts. This docu- 
ment complements information released in the Examiner by provid- 
ing more in-depth review. This is one of seven Updates provided, by 
FairTest on various aspects of testing. 

Unis is avauaDie from rairiest, dox ii/i, v_amuriage, MA i)2Zoo.) 




Fiske, E. 


"America's Test Mania 77 - New York Times (April 10, 1988) Section 
12, pp. 16-20. 

This article contains a general overview of the growth of standard- 
ized testing in America's public schools and the resulting problems. 
It discusses the various uses being made of standardized tests, 
efforts by schools to improve test scores and criticisms and limita- 
tions of standardized tests. It also suggests that standardized tests 
will undermine the goals of the current school reform movement. 




naney, w. 


lest i\ccisoning ana iveasoning auout lesting , ncvtezv oj cauca- 
tional Research (Winter 1984), p. 628. 

This article provides a detailed history of the use of standardized 
tests in America (divided into three eras: pre-WWI; WWI to 1950; 
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and 1950 to present). In particular, it chronicles the recent growth in 
test use and test criticism. The article includes a brief discussion of the 
intensity of use of standardized tests in the public schools and a longer 
discussion of the types of uses, The article concludes by suggesting 
avenues for further research and development in testing. 

Negro Educational Review (Special Issue), 'Testing African Ameri- 
can Students/' (April - July 1987). 

This issue contains numerous articles on testing, including discussions 
of: psychometric, language and cultural biases against Blacks (particu- 
larly working class Blacks) and other minorities; IQ testing and the 
Larry P. decision; and alternatives to standardized tests. 

(This is available from Box 2895, Jacksonville, FL 32203.) 

Phi Delta Kappan (Special Issue). "What is the Proper Role of Test- 
ing," (May 1985), pp. 599 - 639. 

The nine feature articles focus on the use, problems and impact of 
standardized testing in the public schools. These articles coven die 
misuse of SAT scores in assessing the quality of American education; 
the popularity of standardized tests; the impact of testing on pedagogy 
and instruction; problems with teacher testing; the impact of testing on 
educational equity; and alternatives to multiple-choice writing tests. 
One article also provides a description of the use of standardized tests 
to "drive the curriculum" in three states and one school district., 

Z USE OF STANDARDIZED TESTS IN THE PUBUC SCHOOLS 

. ipho, C 'Tracking the Reforms: Part 5 - Testing", Education Week (May 22, 
1985), p. 19. 

One in a series of articles discussing the state education reform efforts 
of 1983 - 1985. This article includes a detailed listing of state usage of 
standardized tests as part of the reforms. 

3. PROBLEMS WITH STANDARDIZED 1ESTS 
Congressional Budget Office. Trends in Educational Achievement (April 1986). 

The first of two CBO reports on educational achievement. It includes a 
general discussion of. the ways in which standardized test results are 
used to measure educational achievement and the problems with such 
uses. The report warns against overreliance on test results in evaluat- 
ing trends in educational achievement. 



40 



39 



(This document is available from the Superintendent of Documents, 
U.S. Government Printing Office, Washington, D.C, 20402.) 

Haney, W. & G. Madaus. "Effects of Standardized Testing and the Future of the National 

Assessment of Educational Progress", VJorking Paper for the NAEP 
Study Group (1986), p. 5* 

This article, commissioned by the Alexander/James Study Group on 
NAEP, documents the increasing attention paid to testing compared 
with curriculum in educational literature. It then discusses four 
broad issues which determine the impact of testing: the subject of the 
test; how tests are referenced; the sources of the tests; and their 
rewards or sanctions. It next lists seven majorproblems regarding 
the impact of tests on individuals and on schooling. The authors 
suggest efforts that can minimize the negative impact and maximize 
the possible benefits of testing. Two sections specifically discuss 
NAEP and its future. 



(This document is available from ERIC Document Reproductions as 
Document Number ED-279-680.) 

Madaus, G. & D. Pullin. "Questions to Ask When Evaluating a High- Stakes Testing 

Program", NCAS Backgrounder (June 1987). 

This report, presented in a question-and-answer format focuses on 
the use of standardized tests in "high stakes" educational situations 
(i.e. where significant sanctions or rewards are associated with the 
test). The report lists several "high stakes" uses of tests. The article 
discusses the ways in which tests are designed or selected. The main 
section of the article examines the potential structure of testing pro- 
grams, possible conclusions that will be drawn from their results and 
their likely impact on students and schools. 

(This document is available from NCAS, 100 Boylston St., Boston, 
MA 02116.) 

National Association for the "Testing of Young Children: Concerns and Cautions" (pamphlet). 
Education of Young Children (NAEYC: Washington, D.C, 1988). 
(NAEYC). 

This pamphlet discusses the potentially harmful impact on young 
children of standardized testing. The pamphlet also describes proper 
uses of standardized tests and suggest how school can "help ensure 
that all children get off to a sound start in kindergarten, first, and 
second grade." 

(This document is available from NAEYC, 1834 Connecticut Avenue, 
N.W., Washington, D.C. 20009.) 



40 



41 



Hoover, M.R., R.L. Polilzer & 
O. Taylor. 



A. Test Bias 

"Bias in Reading Tests for Black Language Speakers: A Sociolin- 
guistic Perspective". Negro Educational Review, (April - July 
1987), pp. 81 -98. 

This article contains a detailed discussion of language-related bias 
in standardized tests against speakers of non-standard English, 
including phonological (sound), syntactical (structural), and lexical 
(work choice and vocabulary) biases. The consequences of bias 
include school program misplacement and tracking resulting in 
inadequate education for those who are not White middle- to 
upper-class. Eliminating these test biases is important for reducing 
educational and societal biases against working class and minority 
children. 



Schmitt, A.P. 



Taylor, O. & D.L. Lee. 



(This article is available from N.E.R. Box 2895, Jacksonville, FL 
32203). 

"Unexpected Differential Item Performance of Hispanic Exam- 
inees on the SAT-Verbal, Forms 3FSA08 and 3GSA08" (Unpub- 
lished statistical report of the Educational Testing Service, 1986). 

This report analyzes student responses on specific SAT questions 
and concludes that Hispanic students scored significantly higher 
than expected on a reading comprehension passage related to 
subjects in which they are likely to have an interest (e.g. lifestyle 
changes in Hispanic families). 

(This article is available from E.T.S., Rosedale Rd., Lawrence, N.J. 
08541.) 

"Standardized Tests and African Americans: Communication 
and Language Issues". Negro Educational Review, (April - July 
1987), pp. 67 -80. 

This article contains a detailed discussion of sources and kinds of 
cultural and language bias in stanc dized tests. These biases 
cause African-American (particularly working-class Blacks) and 
others who are not middle- to upper-class Whites to be invalidly 
assessed: "At times. . . the results fail to accurately represent actual 
abilities." In conclusion, ". . . the very assumptions and paradigms 
upon which most standardized tests are based need to be revised." 

(This article is available from N.E.R., Box 2895, Jacksonville, FL 
32203). 
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B. Test Validation & Reliability 

Cannell, J.J. Nationally Normed Elementary Achievement Testing in America's 
Public Schools: How All Fifty States Are Above the National Aver- 
age. (Friends for Education: Daniels, W.Va., 1987). 

This reports describes the results of,a nationwide survey on achieve- 
ment test scores. It notes that no state average score at the elemen- 
tary level was below the national norm on any of the six most popu- 
lar achievement tests, rhe report concludes that this results from im- 
proper nonhing of the tests and from teaching to the tests. 

(This article is available from Friends for Education, Box 358, 
Daniels, W.Va. 25832.) 

Congressional Budget Office. Educational Achievement: Explana- 
tions and Implications of Recent Trends (August 1987). 

The second of two CBO reports on educational achievement. This 
report includes a general discussion of the problems and limitations 
of standardized tests and particularly the problems around validity 
and reliability of the tests. 



C. Test Administration 

Fuchs, D. & L.S. Fuchs. 'Test Procedure Bias: A Meta-Analysis of Examiner Familiarity 

Effects", Review of Educational Research (Summer 1986), pp. 243- 
262. 

The authors of this report analyzed data from 22 controlled studies 
involving 1489 subjects. Their analysis discovered that familiarity 
with the test examiner had different impacts on test- takers. For low- 
income and Black students, the use of unfamiliar examiners reduces 
test scores, but does not affect the scores of upper-income students. 

Wodtke, K., F. Harper, "Social Context Effects in Early School Testing: An Observational 
M. Schommer & P. Brunelll Study of the Testing Process" (1985). 

Results of a study which examined the administration of standard- 
ized tests in eight kindergartens. It concluded that "testing practices 
in five of the eight kindergartens were so nonstandardized as to 
render their test scores incomparable and quite possibly unreliable 
as well/ 7 It concludes that using results from such administrations is 
likely to lead to unsound educational decisions. 
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4. THE IMPACT OF THE MISUSE OP TESTS 
BY THE PUBLIC SCHOOLS 



Madaus, G. 



Pullin, D. 



Dorr-Bremme, D.W. and 
Herman, Joan L. 



"Test Scores as Administrative Mechanisms in Educational Policy", 
Phi Delta Kappan (May 1985), p. 611 - 618. 

This article provides a very brief history of testing in American public 
schools. It suggests reasons for the increased use of tests in the 
schools. It describes various problems with test use including: a loss of 
authority for teachers' professional judgment; a loss of local control 
over education; narrowing the educational curriculum; teaching to the 
test; a disproportionate impact on disadvantaged students; and the 
elevation of coaching over teaching. 

(This document is available from NCAS, 100 Boylston St., Boston, MA 
02116.) 

"Educational Testing: Impact on Children At Risk". NCAS Back- 
grounder (December 1985). 

This report discusses: the increased use of standardized tests in the 
public schools; their use as barriers to educational opportunity for at- 
risk children; the misclassification of minority students; the impact of 
tests on handicapped students; and the general measurement limita- 
tions of tests. 

(This document is available from NCAS, 100 Boylston St., Boston, MA 
02116.) 

A. Impact on Educational Goals and Curriculum 

Assessing Student Achievement: A Profile of Classroom Practices. 
(Center for the Study of Evaluation: Los Angeles, 1986). 

This article reports on a nationwide survey of teachers and principals 
in 114 school districts. It seeks to identify the amount of time devoted 
to testing, using test results, teachers 7 and principals 7 perceptions 
about testing, and issues of equity as a result of standardized test use. 
Concerns about impact of standardized test use include the fact that 
most teachers pay more attention to standardized test results for low 
SES students than for high SES students, the tests can reduce time 
spent on other curricular goals as tests can lead to narrowed curricu- 
lum. The authors call for a more "rational" relationship between 
teacher-designed tests, external texts and the curriculum, but empha- 
size that the curriculum must drive the tests and not vice versa. 
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Meier, D. "Why Reading Tests Don't Test Reading". Dissent (Winter 1982- 
83). 



Reading instruction aimed at increasing standardized test scores is 
shown to hinder learning to read, since higher test scores do not 
necessarily indicate improved reading ability. The author concludes 
that reading and other tests are biased against minority and low- 
income youth. Tests cannot measure the utility or effect of school 
reforms: ". . . testing not only fails to be helpful but sabotages good 
education." 

National Academy of Education. The Nation's Report Card: Improving the Assessment of Student 

Achievement, Review of the Alexander/James Study Group Report 
(National Academy of Education, 1987), p. 47. 

Although this review discusses the recommendations of the Alexan- 
der/James Study Group to dramatically expand the National Assess- 
ment of Educational Progress (NAEP), it also provides some general 
discussions of the problems of testing. In particular, it notes how 
testing can narrow the curriculum, threaten educational equity, and 
undermine educational goals that are not easily quantifiable. 

(This report is available from NAE, Harvard Graduate School of 
Education, Longfellow Hall, Cambridge, MA 02138.) 

Salganik, L.H. "Why Testing Reforms Are So Popular and How They Are Chang- 
ing Education". Phi Delta Kappan, (May 1985), pp. 607 - 610. 

This article links the growing use of standardized tests in the schools 
with a loss of public confidence in teachers. Because increased 
reliance on testing undermines the authority of teachers' judgments, 
a cycle of declining profession 1 authority and declining public 
confidence is created. It also notes that policy issues, such as educa- 
tional equity, the goals of schooling and control over school deci- 
sions are masked by the emphasis on technical questions regarding 
testing. 

Steelman, L.C. & B. Powell. "Appraising the Implications of the SAT for Educational Policy". 

Phi Delta Kappan, (May 1985), pp. 603 - 606. 

This article focuses on the misuse and misinterpretation of state av- 
erages for SAT scores. A brief discussion concludes that overreliance 
on standardized tests has led to teaching to the test and results in 
school staff discouraging potentially low scoring students from even 
taking the test. 
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Suhor, C "Objective Test&and Writing Samples: How Do. They Affect Instruc- 
tion in Composition?" Phi Delta Kappan, (May 1985), pp. 635 - 639. 



This article criticizes the use of multiple-choice standardized writing 
tests because they undercut "real" writing instruction. The author 
presents a case for the use of computerized "writing sample" tests as 
an alternative. 

Tyson-Bernstein, H. A Conspiracy of Good Intentions: America's Textbook Fiasco. (Coun- 
cil for Basic Education: Washington, D.C., 1988). 

This report discusses the quality of textbooks in the public schools. It 
concludes that the increasing emphasis on testing has been a major 
contributor to the declining quality of American textbooks. In particu- 
lar, it indicts the current "curriculum alignment" movement which 
affects school districts in 22 states. It encourages the use of a more 
diverse curriculum and set of student assessment mechanisms. 

(This report is available from the Council for Basic Education, 725 15th 
St., N.W., Washington, D.C. 20005.) 

B. Impact on Student Progress and Achievement 

Raudenbush, S. "Magnitude of Teacher Expectancy Effects on Pupil IQ as a Function 

of the Credibility of Explanatory induction — A Syntheses of Find- 
ings from 18 Experiments", Journal of Educational Psychology 
(January 1984), pp. 85 - 97.. 

This article reanalyzes the "Pygmalion Effect", originally identified 
and described by Robert Rosenthal and Lenore Jackson in 1965 in 
Pygmalion in the Classroom. In examining data from 18 different experi- 
ments,lt discovered that the Effect was most prevalent among stu- 
dents entering seventh grade, but not those in grades three to six. It 
points out that the effect is most likely to occur when teachers know 
little about their students beyond the statistical information they are 
provided. Where that information (including test scores) under- or 
overestimates students abilities, teacher behavior affects student 
achievement (regardless of previous student achievement levels.) 

Willie, C.V. "The Problem of Standardized Testing in a Free and Pluralistic 
Society". Phi Delta Kappan, (May 1985), pp. 626 - 628. 

This article discusses the disproportionate impact test use has on 
minority students. It notes that tests ignore the diversity in "mental 
patterns" among various American ethnic groups and implicitly 
undercuts their value and legitimacy. 
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G Impact on Local Control 



Wise, A.E. "Legislated Learning Revisited", Phi Delta Kappan (January4988), 
pp. 328 - 333. 

The article demonstrates how the increasing use of standardized 
testing undermines local control over the public schools. The author 
describes various ways in which test use increases state and national 
control over education. He also discusses other impacts of increased 
test use such as narrowed curriculum, loss of teaching time, lower 
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FairTest publications will keep you up-to-date on the growing movement for 
fair & open testing. You will be able to do more than just read about FairTest's 
campaigns— you can help make them successful! 
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National periter for Fair & Open Testing 

Fallout From the Testing Explosion 

More than one hundred million standardized, multiple-choice 
tests were administered to America's public school students 
during the 1986-87 school year, according to a new study by 
FairTest, the National Center for Fair and Open Testing, The 
report finds that over-.reliance on standardized exams damages 
equal opportunity and school quality and "will lead to a worse, 
not better, public understanding of the. schools and a weaker, not 
a stronger., educational system." 

Fallout From the Testing Explosion; How 100 Million 
Standardized Exams Undermine Equity and Excellence in America's 
Public Schools is based on a comprehensive survey of state 
education administrators and a sample of local school officials, 
plus a review of research literature on tests and their use. 

FairTest researchers found bias against minorities and low 
income children, as well as serious problems in test 
construction, reliability, validity and administration. They 
conclude that use of these instruments leads to misplacement of 
students, narrowing of pedagogy and curriculum, and loss of 
control over education to the unregulated testing industry. 

This report should be useful for teachers, administrators, 
parents, policy makers, and legislators concerned about the 
growing use of tests in our schools. An extensive annotated 
bibliography makes this report a particularly valuable resource. 

To order Fallout From the Testing Explosion , send $8.9f 
(postpaid) to: FairTest, P.O. Box 1272, Cambridge, MA 02238. 

O * rrr. " : . V', - - - ^ — : : 
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~ 'TESTING EXPLOSION' ' 2 ... 2 ... 2 

The- FairTest study found that Southern states and larger 
school districts test most often. Most states with no mandated 
tests, have small ^minority populations. Newark, New Jersey, 
reported, the highest rate of testing, with an average of nine 
standardized tests given to each student during 1986-1987. 

FairTest also found that least 13 states and the District of 
Columbia are "aligning" their curricula to reflect the content of 
standardized tests. "Many schools have embarked on a single- 
minded quest for higher test scores even though this severely 
narrows their curriculum," said Dr. Neill. 

"Standardized tests have become the all-powerful gatekeepers 
of American education," FairTest concluded. To counteract the 
overuse misuse of standardized tests, the FairTest report 
advocates four reforms: 

- All tests must be constructed, validated and administered so 
that they measure pertinent, not rxtraneous, differences 
between students; 

- T'ests should be open so that publishers claims can be 
independently investigated; 

- No test score should be used as the sole or primary factor 
in any "high stakes" educational decision; 

- Nfcv; assessment instruments must be developed as alternatives 
and supplements to standardized multiple-choice tests. 

To advance its agenda , FairTest is sponsoring a national 
testing reform confer., nee on "Breaking Down the Barriers" in 
Washington D.C. on Jan' 17 and 16, Leaders of civil rights, 
education reform, and consumer advocacy orgarv tions are expected 
to attend a Friday aftfernoon Capitol Hill reception featuring a 
speech by Sen. Albert Gore (D.-Tenn) and Saturday workshops and 
seminars at Howard University Law School. 

Copies of "Fallout From the Testing Explosion" are available 
for $8.95- from FairTest, P.O. Box 1272, Cambridge, MA 02238. 

FairTest is a national non-profit research and advocacy 
organization funded by grants from the Ford Foundation, 
Rockefeller Family Associates, and individual donors. 
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attached: Key Findings from "Fallout from the Testing Explosion" 
q State-by-State chart of required tests 

< : i^M^i Cgp : ie& $f the full report are available on request qq 



